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Abstract 


Worldwide steel industries are rapidly adopting advance data science, Al, ML 
kind of technologies for increasing interconnectivity and smart automation of 
Article Info their daily processes. As oil and gas companies are seeking higher quality material 
from steel manufacturer, dependency of above technologies is growing very 
fast. Currently, defect detection using computer vision is emerging an important 
Received : 03 February 2022 technology which is impressing all the technologist and convincing people to 
Accepted : 17 April 2022 accept it. In conventional steel slab caster, various types of internal defects are 
Published : 05 May 2022 generated with low to high severity where Centerline Segregation (CLS) and 
doi: 10.51483/l]D SBDA.2.1.2022.26-34 Internal Crack (IC) evolves most significant type of defects, which are likely 
undesirable. Since, those defects cannot be avoided due to solidification of liquid 
steel, dynamic soft reduction technology is universally used for minimizing it. 
Mannesmann standard images is widely used in steel slab caster area for 
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classifying the slab defects severity by comparing the defects printed in sulphur 
printing paper with the standard images by visual observation to assure material 
quality. However, this conventional method is highly error prone dueto variation 
in results for varying judgement by operator to operator. Therefore, a suitable 
scientific method was required to develop for improving reliability of test result. 
In this study, a quantitative model for classification of CLS and IC defect severity 
using advance image analytics technique has been developed and described. 
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1. Introduction 


Computer Vision (CV) is an interdisciplinary scientific field that deals with how computers can gain high- 
level understanding from digital images or videos. Fromthe perspective of engineering, it seeks to understand 
and automate tasks that the human visual system can do. Modernization of technology in steel industry 
demands advanced applications for digitizing and smoothing its operations in terms of productivity and 
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quality. Cast slabs arehot rolled to producesemi-finished products (strip or plate). Figure 1a shows a schematic 
of aslab caster where liquid steel is converted to solid slabs (Figure 1b) (Seppo, 2014). This semi-finished 
product is often used to manufacture pipes for the transport of different media (e.g., gas, oil, process- and 
wastewater). During solidification of the steel in continuous caster results in the formation of Centerline 
Segregation (CLS) as well as different types of Internal Cracks (IC) which are function of thecasting process as 
well as the chemistry of the steel (Yiwenet al., 2019; Ghosh, 2001). In this context, it has been discussed that 
how computer vision based digital image analysis technology can ease for detecting and classifying defects 
and its severity (John et al.,2019; Rajalingappaa etal., 2015). Various types of internal defects like center line 
segregation, transverse and longitudinal internal cracks, triple point crack, black spots etc. areformed during 
slab casting operation in conventional slab caster (Seppo, 2014; Yiwenet al., 2019). Two methods are widely 
used by various steel slab manufacturer for classification of the slab internal defects, one of which is macro- 
etching of slabs and subsequently comparing the defects with standard images wherethesecond method is 
sulphur print technology wheredefects are printed on thesulphur print paper (Figure 1c) followed by comparing 
with standard images (John et al., 2019; |S: 12037 - 1987). 
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Figure 1: (a) Schematic of a Slab Caster; (b) Slab; and (c) Sulphur Print of D efects 
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Figure 2: (a) Mannesmann Standard Images for Centerline Segregation Severity Classes; and 
(b) M annesmann Standard Images for Internal Crack Severity Classes 
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Typically, classification of those defects is carried out manually with comparing to the standard image 
(Mannesmann and VDEh standard) (Figure 2a and 2b) by visual observation which resulted an obvious 
discrimination of defects severity analysis (John e al., 2019; |S: 12037 - 1987). Even poor repeatability of thetest 
results also can be observed. To overcome the issue of manual assessment, a quantitative model has been 
developed which can assess the defect classes quantitatively from sulphur printed image. However, various 
global research is therefor thesame which areless subjective and offers quantification of segregation density 
spreads etc. Spectra energy Incis one of them which evolved a quantitative CLS evaluator that uses circular 
grids of different sizes e.g., Imm, 3mm and 5mm for measurement of segregation dots (john e& al., 2019; José 
et al., 2006). In this experiment, it was a challenge to accept the evaluation of CLS as well as!IC from sulphur 
print image which itself is a unique method. 


2. Experimental 


2.1, Sulphur Printing of Slab Surface 


In Tata Steel, slabs are continuously cast with averagedimension of 1250 X 215 mm cross section through a 
vertical casting machine with Liquid Core Reduction (LCR) technology (Diptak et al., 2017). Slab samples are 
taken from the tail or head end of aslab as shown in Figure 3a, for examining the solidification structureand 
online generated defects like CLS, IC, triple point crack etc. Figure 3b shows the slab sample of a slab after 
cutting transversely. Figure 3c outlines the entire process flow of slab sample preparation for sulphur print of 
defects (Lucieneet al., 2015). The inner surface of theslab is cleaned with 10% HNO, solution. A silver bromide 
(AgBr) based paper is immersed into 5% H,SO, solution. Inner surface of the slab is placed on the silver 
bromide-based paper (!S: 12037- 1987; Lucieneet al., 2015). During solidification of sted, freesulphur forms 
FeSand segregates into thedefective region and oncethe cleaned slab surfaceis placed on the paper, it reacts 
with the it and resulted impressions of all the defects (Figure 1c) on it (Mihalyet al., 2014). Printed paper is 
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Figure 3: (a) Schematic of Slab and Dimension; (b) Slab Sample After Cross-Section Cutting; and 
(c) Process Flow of Sample 
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photographed for comparing thedefects with Mannesmann standard images (Figure 2a and 2b) for classifying 
theseverity. 


2.2. Image Processing for Q uantitative Benchmarking 


It has been discussed in previous section that Mannesmann standard images are widely used for severity 
Classification of all types of slab internal defects. For quantitative benchmarking, processing of Mannesmann 
standard images was carried out for measuring the dot size and shapefor CLS and crack height and width for 
IC. Figure 4 outlines the process flow of the computer vision algorithm of image processing where several 
special image processing techniques was executed. As imagewas taken by thevision camera, therewas ahigh 
probability of poor image clarity. To mitigate the image clarity issue, BLM D-based local adaptive contrast 
enhancement of image was conducted and function of Region of Interest (ROI) were introduced (Jianbo é al., 
2021; Yan et al., 2021). Adaptivethresholding was fitted for the best results for separating out the entiredefects 
from the printed paper background (https:/ / opencv24-python-tutorials.readthedocs.io/ en/ latest/ 

py_tutorials/ py_tutorials.html; Wendi e al., 2018). Usually, CLS generates throughout the center of theslab 
and it appears as dotted straight line (Figure 1b). As other defects arealso appeared in sulphur print, therewas 
arequirement for separating the CLS from them. Therefore, H ough transformation (A Ilamet al., 2015; Opencv- 
Python Tutorial) technique was adopted which showed a clear reference lineof CLS defect [Figure 4 (step 4)] 
and further this referencelinewas utilized for separating out the CLS form other defects [Figure4 (step 5)] by 
image cropping method (Bingliang & al., 2013). Essential mathematical calculations for image cropping to 
select desired object was implemented for obtaining higher accuracy. The cropped imagewas virtually split 
into four number segments to understand the variation of measurements in each segment. In next step, contour 
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Figure 4: Image Analytics Algorithm for CLS and IC 
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Figure 5: Segment Wise A verage D ots Size, Maximum D ots Size and Area of the D ots 
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function and area of the moments were implemented for obtaining segment wise contour of each segregation 
dots (https:/ / opencv24-python-tutorials.readthedocs.io/ en/ latest/ py_tutorials/ py_tutorials.html). Average 
dots size, maximum dots size and area of the dots for every segment interval of the image was measured 
(Figure5) using area of moments. For a2D continuous function the moment of imagecan berepresented by the 
below equation (Equation 1) (George, 2014; Cho-H uak Teh and Roland, 1988; Mohd Wafi e al., 2021). 


My =>) >ox'y/lO.y) (1) 
x sy 


Here, x and y refer to row and column index of 2D matrix and I(x, y) refers to the intensity at the location (x, y). 
Area (for binary images) or sum of grey level (for greytoneimages): M ,,. Whereas centroid can be measured 
using Equation (2) as below (Equation 2) (George, 2014; Cho-H uak Teh and Roland, 1988; Mohd Wafi et al., 
2021). 
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Table 1 shows thesegregation pixel area and dot size distribution of the standard images with respect to 
the defect severity after processing of standard images with various classes. 


Table 1: Quantitative Value of CLS w.r.t D efect Severity (Class) for Each Segment 

Class 2 

Segments Segregation pixel area imm<dots<3mm 3mm<dots<5mm dots<5mm 

1 61.5 4 0 0 

2 76.5 7 0 0 

3 42 4 0 0 

4 15.5 2 0 0 
Class 3 

Segments Segregation pixel area imm<dots<3mm 3mm<dots<5mm dots<5mm 

1 84 8 0 0 

2 100 9 0 0 

3 71.5 5 0 0 

4 68.5 7 1 0 
Class 4 

Segments Segregation pixel area imm<dots<3mm 3mm<dots<5mm dots<5mm 

1 191 8 2 1 

2 240.5 9 3 0 

3 234.5 5 3 1 

4 161.5 10 3 1 

[eng 5 

Segments Segregation pixel area imm<dots<3mm 3mm<dots<5mm dots<5mm 

1 367 6 1 4 

2 347.5 9 3 1 

3 295.5 10 3 1 

4 237 12 2 0 


AsIC has aspecific morphology of its appearancewhich is perpendicular to theCLS (Figure 2b). Therefore, 
three quantitative parameters wereimplemented for measuring severity, i.e. (a) averagenumber of cracksin 
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each segment after dividing entire image into 4 parts; (b) averageheight of the crack in each segment; and (c) 
average maximum height of the crack in each segment. Table2 shows the quantitativereference of standard 
images containing for classification of input!C defect severity. 


For both quantitative analysis averageslab thickness was considered as referenceframe for a given input 
image for calculating pixel per matrix. 


Table 2: Quantitative Average Value of IC Defects w.r.t D efect Severity (Class) for Each 100 mm Segment 


Average value of each segment | Class 2 | Class 3 Class 4 Class 5 
Average Number of cracks | 10 | 17 23 23 
Average height of cracks | 9.7 | 15 20 25 
Average max. height of cracks | 17 | 57 92 117 


Mannesmann image quantification for CLS 
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Figure 6: A verage of M ax D ot Size, Area of the D ots, Number of D ots of Standard Image for CLS 


3. Results and Discussion 


Quantitative benchmarking of standard images using advanceimageanalysis technique resulted a reference 
structured values for evaluating input sulphur print images which enables overcomethe standard practices 
where human intervention can be neglected. Figure 6 illustrates the variation of average dots size, average 
number of dots and average area of dots with respect to severity of CLS defects. It was observed that number of 
segregation dots is inversely proportional to the area and sizeof thesame. 
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Figure 7: Average of Crack H eight, M ax Crack H eight and N umber of C racks of Standard Image for IC 
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Similar chart was also obtained after quantification of standard image for IC defects. Figure 7 showsthe 
variation of average crack height, maximum crack height and number of cracks with respect to IC defect 
severity classes. 


3.1. Evaluation of Sulphur Printed Images 


Thedevdoped model was then used for evaluating input sulphur printed images. Using structured reference 
values (Tables 1 and 2), severity of CLS and IC for 100 input sulphur print images was carried out. The 
resulting segregation pixel areas of all segregation dots per segment of the current input image was analyzed 
using this developed tool and severity class of each input images was recorded. Additionally, the size and 
distribution of the segregation dots was also included in the analysis process output. 


Figure8shows an exampleof model output for an input sulphur print image (Figure 8a) where in-between 
constructed image (Figure 8b) has been developed after implementing of threshold function followed by contour 
of each dots has been determined (Figure8c). Both sideinternal cracks have been measured in terms of number 
and height by this model. Comparing the contour values with pre-determined referenceresulted severity of 
CLS=2 and IC =2. Severity class of mode output was cross validated with spectralnc method which showed 
around 95% modedi accuracy. 
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Figure 8: (a) Input Sulphur Print Image; (b) Constructed Image After Thresholding; (c) Contour of 
Segregation D ots; (d) Contour of Internal Cracks 


4. Conclusion 


An image processing tool was developed for quantifying the classification of defect severity of slab from 
sulphur printimages. This devdopment helpsto irradicatethe conventional methods for rating/ classification 
of defect severity where human intervention was involved. Thetool can besuccessfully applied to steel slab 
casting area for quality assessment of theslabs. The prospect of the current tool for providing quantitative 
estimation for all typeof natural distribution of segregation dots (shape, size, density etc.) as well asinternal 
cracks will enable steelmakers to evolve a more meaningful objective of classification system for centerline 
segregation and internal crack analysis from sulphur printimage. 
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